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CCTV Closed-circuit television 
CPNS Calon Pegawai Negeri Sipil — Candidates of Civil Servant 
KJP Kartu Jakarta Pintar — Scholarship for Students from lower income families in 
DKI Jakarta 
MoEC Ministry of Education and Culture 
TK Taman Kanan-kanak — Kindergarten 
TKD Tunjangan Kinerja Daerah — Local Performance Allowance 
TPG Tunjangan Profesi Guru — Teacher Professional Allowance 
PAUD Pendidikan Anak Usia Dini — Early Childhood Education 
PKG Penilaian Kinerja Guru — Teacher and Principal Performance Assessment 
PNS Pegawai Negeri Sipil — Civil Servant 
PRP Performance-Related Pay 
SD Sekolah Dasar — Primary School 
SLB Sekolah Luar Biasa — Inclusive School 
SMP Sekolah Menengah Pertama — Lower Secondary School 
SMA Sekolah Menengah Atas — Upper Secondary School 
SMK Sekolah Menengah Kejuruan — Vocational School 
SNED Sistema Nacional de Evaluaci6n del Desempefio Docente - Chile’s National 
System of School’s Performance Assessment 
UKG Ujian Kompetensi Guru — Teacher Competency Assessment 


1. Introduction 


Teachers are the most critical factor in the provision of quality education services. In the 
United States, students with great teachers advance 1.5 grade levels or more over a single 
school year, compared with just 0.5 of a grade level for those with ineffective teachers 
(Hanusek, 1992). Teacher quality can matter even more in developing countries (Bau and Das 
(2017); as cited in the World Development Report 2018).1 Despite important differences in 
teacher effectiveness, there is little consensus regarding what determines teacher 
performance. Education systems across the world have implemented various types of policy 
actions to improve the performance of teachers. One of the most popular policy interventions 
is ‘merit pay’ which has generated considerable debate concerning its effectiveness. 


In 2005, Indonesia passed a new ‘Teacher Law’ (Law No. 14/2005 on Teachers), which aimed 
to improve the quality of Indonesian teachers, while also launching a massive program on 
teacher incentives. To improve teacher quality, the Teacher Law included provisions to 
professionalize the teacher work force by requiring, among other things, that all teachers 
should have a Bachelor’s degree. In order to motivate teachers to improve their credentials 
and also support teacher wellbeing, incentives were offered for teachers to fulfil a 
professionalization program, at the end of which the teachers became certified. Once 
teachers are certified, they then become eligible for the teachers’ professional allowance 
(Tunjangan Profesi Guru, TPG).?. 


Furthermore, some local governments have also established an allowance program to 
support teacher performance. Some of these allowances are merit-based. One of the major 
teacher allowance programs established outside the national programs is the local 
performance allowance (Tunjangan Kinerja Daerah, TKD), established by DKI Jakarta. In 2018, 
the DKI Jakarta government introduced the TKD for all its civil servants (Pegawai Negeri Sipil 
— PNS)—including teachers—under the assumption that it would contribute toward 
improving their performance. In the case of teachers, performance is measured by a selected 
set of variables at individual and group levels. The variables were selected based on their 
relationship with student learning outcomes, as shown by local and international evidence. 


1 The report highlighted how unskilled and unmotivated teachers was one of the four immediate factors that 
explained why learning failed to occur. 

? A different type of allowance, to motivate teachers to teach in rural, remote and border area schools, the 
teachers’ special allowance (Tunjangan Khusus Guru, TKG), was also set up by the central government. The 
amount of the allowance is equivalent to a teacher’s base salary. A teacher who is awarded both the TPG and 


the TKG will receive a pay check equivalent to three times their base salary. 
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Box 1: Understanding the difference between teacher professional and performance allowances 


Although similar in that both are aimed at improving teacher incomes and wellbeing, the (national) 
teacher professional allowance (TPG) and the (local) performance allowance (TKD) are 
implemented differently. The former is designed to provide an incentive for all teachers to improve 
their competency and awards their certification. All certified teachers, regardless of the status of 
their employment (PNS or non-PNS), receive the TPG allowance ona continuing basis. Meanwhile, 
the performance allowance in DKI Jakarta is only available to civil servant teachers (PNS) under the 
government of DKI Jakarta. This means, therefore, that if a teacher in DKI Jakarta is a civil servant, 
has met the performance criteria and has achieved certification in his/her subject of teaching, 
he/she will receive both TPG and TKD. 


Table A: Comparison between TPG and TKD 


Teacher Professional Allowance (TPG) | Local Performance Allowance (TKD) 
Program All teachers, principals and supervisors | All teachers, principals and 
Coverage nationwide supervisors in DKI Jakarta 
Beneficiary Certified teachers (applies to both PNS_ | Civil servants of the local 
Eligibility and non-PNS) government of DKI Jakarta (applies 
to PNS and candidate PNS) 
Allowance Fixed amount, double the basic salary Varying amount based on a formula 
Amount 
Variables N/A - Attendance 
- Performance 
Regulation Teacher Law No. 14/2005 Governor’s Regulation No. 22/2017 


This study reviews the implementation of the TKD program related to teachers in DKI Jakarta 
to identify any initial behavior changes resulting from the policy. The objective of the study is 
twofold: 


1) To identify the level of understanding of stakeholders regarding the performance 
allowance; and 

2) To identify the impact of the performance allowance on the performance of teachers 
and other education staff. 


2. Global Evidence on Teacher Incentives 


Although there is a wide variety of existing programs, there are three main models of 
performance-based reward programs that are commonly examined in the literature and are 
found in education systems. The first model is ‘merit pay’, which generally involves individual 
pecuniary rewards based on student performance and classroom observation. The second 
model is ‘knowledge- and skill-based’ compensation, which generally involves individual 
pecuniary rewards for acquired qualifications, and demonstrated knowledge and skills that 
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are believed to increase student performance. The third model is 


‘school-based 


compensation’, which generally involves group-based pecuniary rewards, typically based on 
student performance (Beavis, 2003). Beavis also described arguments that support 
performance pay, together with arguments against it (Table 1). 


Table 1. Arguments that support and oppose performance-based rewards 


Arguments In Support of Performance-Based 
Rewards 


The current system is unfair and rewards experience 
and formal qualifications instead of performance. 


Performance-based rewards improve the 
governance of schools by increasing the efficiency 
of resource allocation. 


Performance-based pay motivates teachers to 
perform at their best. 


There is increased collegiality between teachers and 
administration. 


Student performance is increased. and teacher 
quality improves. 


The market provides the best approach for efficient 
allocation of resources, and this model can be 
applied to teaching. 


Relative to other education reforms. performance- 
based rewards provide a relatively cost-efficient 


Arguments Against Performance-Based Rewards 


Fair and accurate evaluation is difficult because 
performance cannot be determined objectively. 


School administration becomes hierarchical and co- 
operation between school management and staff is 
strained. 


Performance-based financial incentives do not 
provide incentives for teachers to improve. 


There is reduced co-operation between teachers. 


A range of perverse outcomes occur because of 
teacher ‘game playing’ and a narrowing of the 
curriculum. 


The market has no place in education. 


To implement a performance-based scheme is 
expensive and time consuming. 


solution. 


Source: Beavis, 2003 


Some studies find that there is no link between allowances and teacher performance, or 
student learning outcomes. Astiti, Wilian and Sridana (2018) find that the teacher professional 
allowance does not affect teachers’ working performance. Parsa (2017) finds that allowances 
received by SMK teachers in East Nusa Tenggara province did not have any direct positive 
effect on teacher performance. A World Bank publication entitled “Double for Nothing” 
(2017) also provides evidence that the national teacher professional allowance program in 
Indonesia has had no impact on student learning outcomes. A similar study in The Gambia 
finds no positive overall impact of student learning outcomes resulting from a hardship 
allowance for teachers, although the zero average effects do hide important heterogeneity, 
with student learning gains for students at the top of the distribution, and losses for those at 
the bottom (Pugatch and Schroeder, 2014). Despite these rather disappointing results, 
Chelwa, Pellicer and Maboshe (2018) find that the allowance increased the number of 
teachers attendance in rural schools by about 10 percent and succeeded in keeping more 


teachers in their schools for the full academic year.? However, once again, there was no effect 
on student learning outcomes. Lastly, a recent World Bank publication concludes that there 
is a wide range of results from teacher incentive programs in terms of educational outcomes, 
with some interventions reporting significant effects and some reporting smaller or negligible 
effects. However, the design of the incentive scheme and the context in which it operates 
seem to play an important role in learning outcomes (Lee and Octavio, 2019). 


The Program for International Student Assessment (PISA) 2009 report describes OECD 
countries that applied teacher performance-based pay schemes. The report suggests that, in 
countries where teachers’ salaries are relatively small (15 percent of GDP per capita or less), 
performance pay does help improve learning outcomes, while in those countries that have 
higher salaries the scheme fails to have any effect (OECD, 2010). The findings from a case 
study in Andhara Pradesh, India, show that: (i) paying teachers extra if their students do well 
on tests is highly effective; (ii) individual incentives are more effective than group-based 
incentives; (iii) incentive bonuses in general work better than giving schools money for extra 
inputs that are unconditional on outcomes; (iv) not all teachers respond equally to incentive- 
based pay, with teachers on a higher base pay responding less well to the individual or group- 
based incentives, while more experienced teachers also do not respond as well to incentives; 
and (v) performance-based pay schemes can help to attract better teachers into the 
profession (World Bank, 2010). 


Following on from this, a crucial factor in successful teacher incentives is their accountability 
mechanism. For example, if attendance is one of the key indicators of formula for the teacher 
allowance, there is a need for a robust measure of accountability to check teacher, principal, 
and supervisor attendance’. It is not sufficient just to ensure that teachers simply come to 
school, but a mechanism is also needed to check that teachers are present in the classroom 
and deliver their lessons, or fulfill their supervision roles. In an intervention in India, 
researchers found that teacher incentives reduced teacher absenteeism and increased 
students’ test scores, with the teachers’ attendance monitored using CCTV (Duflo et al., 2012). 


Teachers interviewed for this study also mentioned the fairness of the criteria used for the 
performance indicator calculations. Several studies that found positive effects for both 
individual and group-based incentives, report that the latter tend to have less effect.* 


In Chile, the Ministry of Education implemented a regional teaching excellence award called 
the National System of School’s Performance Assessment (SNED). SNED teaching excellence 
awards are determined by several criteria, including a school’s student grade repetition and 
dropout rates, equity policies, new initiatives, integration of teachers and parents, and 
improved working conditions. However, student performance is the primary criteria (65 
percent of the award decision). Within a given region, schools with similar student and school- 
level characteristics are divided into homogeneous groups and compete with each other ina 
rank-order tournament according to their average performance. This has been shown to 


3 The study was conducted in rural areas, where teachers often leave school in the middle of an academic year 
to pursue their careers in urban areas. Teachers who received the incentives tended to stay in rural areas for 
the full academic year, half a year longer than their peers who do not receive the incentives. 

4 Cited in Lee and Octavio, 2019. 


improve the overall educational attainment and reading performance of the students (Alger, 
2014). In the United Kingdom, through a performance-related pay (PRP) incentive scheme in 
the early 2000s, England and Wales also show similar results using a different set of formulae 
(Populus, 2013). The PRP system was found to be effective in increasing teacher effort and 
resulted in higher student learning outcomes. Teachers prefer to be paid based on their 
performance, measured by annual appraisal (43 percent) and student exam results (29 
percent), as opposed to seniority or qualifications. The PRP encompasses four input-based 
standards related to teaching management and skills, and one standard relating to students’ 
academic progress. 


3. The Jakarta Teacher Incentive Program 


The Government of DKI Jakarta promulgated Governor’s Regulation No. 22/2017 on local 
performance allowances for teachers and educational staff, which was subsequently revised 
by Governor’s Regulation No. 56/2018. The regulation states the variables, the mechanism 
and the calculation of the allowances. The objective of the performance allowance scheme is 
to improve performance, school discipline, welfare and service quality of civil servant 
teachers. 


The recipients of the performance allowance are principals, vice-principals, teachers and 
supervisors in public schools, together with penilik (supervisors in non-formal education) and 
pamong (civil servant teachers in non-formal schools). The variables consist of presence and 
performance indicators. The composition of the allowance as provided in Table 2. 


Table 2. Percentage of presence and performance variables 


No Allowance recipients Presence Performance 
(%) (%) 

1 Principals, vice-principals, teachers 70 30 

2 Supervisor (formal and non-formal) 60 40 

3 Pamong (teacher in non-formal) 50 50 


The presence variable is negative, meaning that when civil servants are absent for any reason, 
the incentive will be reduced depending on the reason (sick, on leave, or no reason) and the 
number of days absent. The level of reduction is between 1.0 and 2.5 percent, except if no 
reason is given, in which case the civil servant will incur a 5.0-percent cut. 


The performance variables consist of individual variables and group variables. The details of 
the variables, including the proportion of each variable, depend on the type of job, i.e., 
principals are different from teachers, etc. As an example, teacher variables are shown in 
Table 3. 


Table 3. The portion of performance variables for teachers 


No Performance variables Portion of total 
performance 
allocation (%) 

1 Teacher competency test 30 

2 Teacher performance assessment 30 

3 Average examination score 10 

4 Improved examination score 10 

5 School performance (academic/non- academic) 10 

6 Reduction in student misbehavior (bullying, drug 10 

abuse, etc.) 
Total 100 


For each of the performance variables, there is an indicator and rules that enable a teacher 
to receive more or less depending on their performance on each variable. The total amount 
of 100 percent of the allowance varies depending on the level of civil servant (golongan). The 
level is usually determined by the number of years of experience, and education and 
performance assessments. The maximum amount that teachers can receive in the form of 
allowances are shown in Table 4. 


Table 4. Maximum allowance for teacher per civil servant level 


No Level (golongan) of civil servant Amount (IDR) 
1 IV/d—-IV/e 9,360,000 
2 IV/a—IV/c 9,045,000 
3 II/c —UI/d 8,910,000 
4 Il/a —III/b 8,010,000 
5 l/a—II/d 6,210,000 


The amounts shown in Table 4 are lower than non-teacher/education staff rates, since 
principals and vice-principals can receive higher amounts than teachers, as shown in Table 5. 


Table 5. Maximum allowance for principals and vice-principals per level of education 


No Level of education Principal (IDR) Vice principal (IDR) 
1 TK, SLB 11,400,000 10,070,000 
2 SD 12,000,000 10,545,000 
3 SMP 17,000,000 10,830,000 
4 SMA, SMK 19,000,000 11,922,500 


Performance variables are characterized by individual variables such as the teacher 
competency test (UKG) and teacher/principal performance assessment (PKG), and group 
variables such as national examination scores, school achievement in selected competitions, 
and reductions in student misbehavior (student fights or bullying, etc.). For principals, the 
variables also include targeting for the scholarships for poor students’ program (KJP) and the 
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school’s collective score in the UKG. Data on UKG, PKG, and school examination scores are 
input into the system by the education office as it compiles data from outside sources 
(Ministry of Education and Culture, MoEC). Data on KJP targeting and student misbehavior 
are input by school supervisors. 


Table 6. Performance indicators and the collection mechanism 


No Indicators Collection mechanism 

1 Teacher competency test (UKG) Collected from national data system 

2 Teacher/principal performance Collected from national data system 
assessment (PKG) 

3 National examination scores Collected from province data system 

4 School achievement in academic School input on the teacher performance 
competitions allowance data system 

5 School achievement in non- School input on the teacher performance 
academic competitions allowance data system 

6 Student misbehavior School supervisor input on the teacher 

performance allowance data system 

7 KJP (scholarship for poor student School supervisor input on the teacher 
program) targeting performance allowance data system 

4. Conclusions 

1. Most teachers (86.7 percent), vice-principals (78.6 percent) and principals (100 
percent) are aware of the performance incentive allowance policy. Although some of 
them do not know the details of the allowance formula, this is not an issue since they 
rely on school operators (designated person at the school for data entry) to input their 
data into the system. 

2. Teachers on the whole view the incentive scheme positively (on a scale of one to five, 
the score is 4.43), since they perceive that it serves to increase school discipline, 
motivates them to improve competency, and supports a competitive spirit. However, 
some feel that the program have negative effect (on a scale of one to five, the score 
is 3.09). They perceive that the scheme has no effect on improving teamwork (3.42), 
there are gaps in the allowances received between teachers (3.29) and that incentives 
do not have effect on overall school performance (3.29 in scale 5). 

3. There is no significant difference in the amount of the allowance received by teachers 


and principals. The main issue for teachers is the share between the attendance 
variable and the performance variables, which is currently 70:30. Most teachers 
attend school and, even when they are absent, the allowance deduction is very small. 
Given the higher proportion awarded to attendance in the formula, this results in no 
significant difference in the total amount of allowance received. Conversely, the 
variance in the performance variables is significant. However, given that the portion 
is relatively small (a total of 30 percent for all performance variables), it does not affect 
the total allowance received a great deal. 
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Individual variables, for example, the teacher performance assessment (52.2 percent) 
and the teacher competency test (58.6 percent), seem to contribute more than the 
group variables in the performance portion, i.e., school achievement (36.8 percent) 
and increased exam scores (28.2 percent). This is in line with the findings from the 
case study in Andhara Pradesh, India, that shows that individual incentives are more 
effective than group-based incentives in improving teacher performance. 


. Recommendations 


The performance allowance has achieved a high level of ownership and receives 
positive feedback from school members (teachers, principals, and vice-principals). The 
fact that some of school members did not know the details of the formula suggests 
that more detailed information needs be provided to allowance recipients. If the 
government wishes to continue with the program, then there are ways to adjust the 
scheme which could increase the likelihood that the scheme can meet the intended 
objectives. 

The share of attendance versus performance variables needs to be revised. Giving a 
greater weight to performance in the allowance would possibly help to improve the 
impact on behavior change related to teacher performance. 

The program needs to focus more on variables that have a direct link to the individual 
performance of school members and less on group variables in the performance 
portion. It does not mean that the group variables are not important, given that this 
is the first year of implementation of the program. However, the program needs to 
find group variables that have a more direct link to individual performance. 
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6. Approach and Methodology 


A survey was implemented in 2019 to assess the familiarity of the key stakeholders in DKI 
Jakarta with the performance incentive scheme and to identify potential behavior changes as 
a result of the scheme. Fieldwork included 90 schools across education levels, with 
respondents consisting of principals (15 respondents), vice-principals (15 respondents), 
supervisors (15 respondents) and teachers (45 respondents). For each level of education, 
consisting of elementary (SD), junior secondary (SMP), senior secondary (SMA), vocational 
senior secondary (SMK), and schools for children with disabilities (SLB), three principals, three 
vice-principals, and nine teachers were selected randomly for the survey. Stratification was 
based on school size, categorized into large, medium and small schools. The distribution of 
the sample is shown in Table 7. 


Table 7. Sample of the study 


education School size Respondents 
Laval Small | Medium | Large | TOTAL | Principals te Teachers | Supervisor | TOTAL 
prin. 
SD 1 1 1 3 3 3 9 3 18 
SMP 1 1 1 3 3 3 9 3 18 
SMA 1 1 1 3 3 3 9 3 18 
SMK 1 1 1 3 3 3 9 3 18 
SLB 1 1 1 3 3 3 9 3 18 
Total 5 5 5 15 15 15 45 15 90 


The study evaluates the implementation of the teacher allowance program in 2018, the first 
year of program implementation. 


5. Findings 


1. Awareness of performance allowance policies 


Awareness among stakeholders is essential if the policy is to lead to its intended behavior 
changes. Without knowing the details of the program, how it works, and what the policy 
impact is supposed to be, those targeted by the program will behave as in a business-as-usual 
scenario. As such, principals and teachers who are unaware of the existence of the TKD 
program will not modify their efforts or teaching behavior, thus undermining the amount of 
incentive payments that they might ultimately have received. 


Were they aware of the policy? Most teachers and vice-principals, and all principals, knew 
about the performance incentive allowance policy. The provincial education office (Dinas 
Pendidikan DKI Jakarta) seems to have been effective in disseminating the new policy to 
schools through a major information campaign. While its website was not effective in 
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informing stakeholders of the policy, the use of mass-media seems to have been more 
effective. 


Figure 1. Knowledge of allowance policy 
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Figure 2. Source of information about the performance allowance policy 
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Were they aware of the formula that generates the incentive? To calculate the performance 
incentive allowance, a different formula it used for each type of recipient. The beneficiaries 
can learn more about the formula from DKI Governor Regulation No. 22/2017 and it is 
included in the application process. An allowance recipient reports all the necessary data in 
his/her application and can then calculate the allowance he/she should receive based on the 
information provided for each variable. An understanding of which formula is used and how 
the allowance is calculated are important to the effectiveness of the program. 


The study found that only about 55 percent of teachers, 64 percent of vice-principals and 80 
percent of principals knew how to calculate their respective allowances. For the remaining 
allowance recipients, it is likely that many simply allowed the school operators to help them 
input their applications. 
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Figure 3. Knowledge of allowance formula 
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Although many allowance recipients did not know how to calculate their allowance from the 
formula, they nonetheless seem to have had few difficulties in knowing the amount they 
should receive. This is because most allowance recipients receive help from school operators 
with the application process and the process also tells recipients the amount they could 
receive based on the information reported in the system, even if they do not know how to 
calculate it. 


Table 8. Level of difficulty in calculating the variable 


Difficulty in Not difficult (%) | Quite difficult (%) | Difficult (%) 

calculating 

variables 

Attendance Teacher 95.56 2.22 2.22 
Vice-principal 85.7 0.0 14.3 
Principal 93.3 6.7 0.0 

Performance Teacher 88.89 4.44 6.67 
Vice-principal 85.7 7.1 7.1 
Principal 93.3 6.7 0.0 


Can they provide the required information for the formula calculation? To calculate the 
performance incentive allowance, teachers and other recipients need to input their details 
into the online system developed by DKI Jakarta Government. Some applications related to 
the allowance consist of e-absensi (to note attendance), e-kinerja (to input the performance 
variables), and e-tkdbkd.jakarta.go.id (for all variables). The study shows that most teachers 
and vice-principals, and all principals were familiar with the application process. However, 
about 10 percent of teachers and seven percent of vice-principals had problems using the 
application. 
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Table 9. Difficulties in operating the application 


No Level of difficulty Teachers (%) Vice-principals (%) | Principals (%) 
1 Easy 88.89 92.86 100 

2 Quite difficult 2.22 

3 Difficult 8.89 7.14 


2. Perceptions regarding the formula 


Adequacy, complexity and fairness. Most teachers said that the number of variables was 
adequate, while only a few teachers said that the variable number was too small and a few 
thought additional variables should be included. Some teachers thought that the formula was 
rather complicated (22 percent) and needed to be fairer (22 percent). 


Table 10. Teacher perceptions regarding the formula 


Less (%) Enough (%) More (%) Too much (%) 
Adequacy of the 8.89 86.67 2.22 2.22 
variables 

Simple (%) Quite Complicated (%) Very 
complicated (%) complicated (%) 

Complexity of the 71.11 22.22 4.44 2.22 
variables 

Yes (%) No (%) 
Fairness of the 77.78 22.22 
variables 


Perceptions of TKD. The study asked respondents about their perceptions of the performance 
allowance program using a scale from one to five to express their opinion regarding the 
impact of the allowance. On the positive side, respondents felt that the allowance was very 
helpful in terms of their behavior, such as imposing better school discipline, improving 
teaching competency and increasing incomes. However, using the additional income to buy 
learning tools seemed to be the lowest priority. 


This finding may signal how recipients respond to the formula’s incentive. Since the largest 
portion of the incentive comes from attendance, improving their attendance is foremost in 
the minds of teachers. While supporting competitiveness and motivation to improve teacher 
competency comes next, if the main objective of the program is to improve teacher 
performance and student learning outcomes, then this will need to come first. Teachers need 
to be motivated to improve their competency and focus more on student learning outcomes, 
but the formula can only provide this incentive if the weight of this incentive is increased. 


Table 11. Perceptions regarding the allowance 


| No | Perceptions regarding the allowance | Mean | Std. Dev. | 
P[Positiveopinions CTC 


Motivates to improve competency 
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3 | Supports competitive spirit 4.60 0.54 


3 


Average 


Negative opinions 


Teamwork is same as before 


2 | High gap in allowances among teachers 3.36 
3 | No significant impact on school performance 3.29 


The allowance formula is not fair 
behavior change 
formula 
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; No relation between performance and 
allowance 


It is unfair as young teachers can receive 
more than older teachers 


The allowance payments are too high 2.76 


10 | Increases unhealthy competition 2.69 


13 
13 
.07 
2.87 


= 
wn 
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Average 


On the negative side, regarding the fairness of the formula, the impact on performance and 
the lack of progress in school timework, respondents seemed ambivalent, or had no strong 
opinions on these issues. Looking at the scores, it can be concluded that teachers felt that 
the allowance was ineffective in improving school teamwork, although the group variables 
were supposed to improve this aspect. Teachers also felt that the difference between the 
allowances that teachers received was too wide. 


Looking at the averages, it can be said that teachers interpret the performance allowance 
more positively than negatively in regard to the effect on their behavior. 


3. How are the allowances received? 


What teachers actually receive. Teachers and other school staff receive the allowance on the 
224/23" of every month. No teacher received the maximum amount of the allowance, i.e., 
scored 100 points for each variable and in total. It is difficult to score 100 points on the teacher 
competency test and teacher performance assessment. Note too that only a few schools can 
win awards in academic or non-academic competitions. On average, teachers scored about 
90 percent of the allowance, with a seven percent standard deviation. 
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Table 12. Percentage of allowance received and the standard deviation 


No Month Teachers Principals 
1 November 2018 89.8 (7.52) 89.4 (6.5) 

October 2018 90.4 (7.62) 88.0 (6.7) 
3 September 2018 89.9 (7.47) 89.9 (6.4) 


The scatter plot in Figure 4 shows the link between performance allowance and teacher 
quality. We approach teacher quality with school size, assuming that the higher the school 
size (and thus more teachers), the higher the quality of teachers. The figure shows that most 
teachers received the same allowance. It also shows that the linear regression line (Fitted 
values) is almost inelastic (flat), indicating that the difference in quality does not correlate 
with allowances. 


Figure 4. Scatter plot of teacher allowance received and number of teachers 
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It seems that the difference in allowances received by school staff are relatively modest 
compared with their total compensation package additional money they receive. The 
difference between a member of staff who invests significant effort in order to receive a larger 
allowance, and one who does nothing or continues as normal, is about 10 percent of the 
allowance. When other compensation elements are factored in (basic salary, TPG, TKD), the 
variance between the top and bottom performers in terms of incentive is only about 3 percent 
of a teacher’s total compensation. In terms of the capacity of the incentive system to bring 
about significant behavior change, this difference is simply not large enough. 
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The variation of allowance variables 


These findings show that the variations in allowance received are not large. The gap between 
the amount received by teachers with low scores and the maximum allowance for scores of 
100 points among teachers are not very important°. The follow-up question then becomes: 
is the variation linked to the share of the variables, or the type of variables? 


As described before, two components contribute to the allowance: presence variables and 
performance variables. Presence contributes 70 percent, while performance contributes only 
30 percent. Presence is measured using negative variables, which means that being absent 
for any reason will result in a reduction in the allowance received by a certain percentage. 
Performance variables consist of both positive and negative indicators. 


Share of attendance variables 


Most respondents, including teachers, principals, and vice-principals in the study, receive 100 
percent of the attendance allocation, as they are not absent for any reason. When a member 
of staff is absent, his/her allowance is reduced accordingly. The data show that the deductions 
are not significant, at around only 3 percent, or about IDR 180,000, of the maximum 
allowance of IDR 6,000,000. However, the fact that only a small number of teachers, principals 
and vice-principals are absent shows that they almost always attend school.® Since the portion 
of attendance in the total allowance is 70 percent, the dynamic of this variable has a stronger 
influence on the dynamic of the total allowance. It appears that the low variance in the 
allowance is because of the low variance in teacher attendance. 


Figure 5. Percentage of attendance allocation received by teachers 
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5 Comparison is made between the actual allowance received by the teachers (findings) and the ideal range 
determined by the regulation, which should be between IDR 6,210,000 to IDR 11,922,500. 
5 Most public schools in DKI Jakarta use finger print mechanisms to report presence. 
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The standard deviation is almost zero (1.14 percent), which means that most teachers are 
strongly skewed toward the average, which also means almost full percentage attendance 
allocation, as there is no significant variation in teacher attendance. As seen in Figure 5, most 
teachers attend schools and hence receive 100 percent of their allowance for the attendance 
component of the incentive. 


Figure 6. Percentage of attendance allocation received by principals 
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Similarly, the standard deviation for the attendance allocation for principals is 0.85 percent. 
Such a small standard deviation means that the variation of the data for principals is also not 
significant. 


Figure 7. Percentage of attendance allocation received by vice-principals 
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The standard deviation is 2.47 percent for vice-principals, which is likewise modest and 
means that the variation of the percentage attendance allocation for vice-principals is also 
not too significant. 


Share of performance allocation 


The study found that the allowances received by teachers and principals mostly comprise the 
individual variables. For teachers overall, most teachers received part of their allowance for 
their performance against the variables for the teacher competency test (60 percent of 
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teachers) and the teacher performance assessment (50 percent), while for principals, beside 
both of these variables, the KJP targeting also contributes significantly to their allowance. 


Table 13. Performance indicators and the data-collection mechanism’ 


No Indicators Collection Mechanism 

1 Teacher competency test (UKG) Collected from national data system 

2 Teacher/principal performance Collected from national data system 
assessment (PKG) 

3 National examination score Collected from province data system 

4 School achievement on academic School input on the teacher performance 
competition allowance data system 

5 School achievement on non- School input on the teacher performance 
academic competition allowance data system 

6 Reduction in student misbehavior School supervisor input on the teacher 

performance allowance data system 

7 KJP (scholarship for poor student School supervisor input on the teacher 

program) targeting performance allowance data system 


Among the performance variables, some contribute more than others to the allowance 
received. For teachers, it seems that the teacher competency test and the teacher 
performance assessment contribute most to the allowance (totaling about 60 percent of the 
total allowance). While for principals, the principal performance assessment and whether the 
scholarships for poor student program (KJP) is well targeted are major contributors to their 
allowances. 


Figure 8. Contribution of each variable of performance allocation (teachers) 


Teacher Competency Test (RTT 53.6% 
Teacher Performance Assessment STS 52.2% 
Average Exam Score NN 42.1% 
School Achievement NN 36.3% 
Student Behavior SR 23.9% 


Increased Exam Score RN 23.2% 


0.0% 10.0% 20.0% 30.0% 40.0% 50.0% 60.0% 70.0% 
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Figure 9. Contribution of each variable of performance allocation (principals) 


Principals Performance Assessment (iS 90.4% 
Targeting of JP Program ST 33.3% 
Principal Competency Test SRT 75.6% 
Student Behavior 9 69.2% 
School Achievement ST 69.2% 
Increased Exam Score (TT 59.0% 
Average Exam Score NS 53.3% 


Collective score of Teacher competency test NN 36.1% 


These data show that the gap between the maximum score and the real score is relatively 
wide. The differences in scores that lead to different allowances are also significant. However, 
given that the performance portion of the total allowance is only 30 percent, these significant 
differences impact the total allowance proportionately less. This is why the dynamics in the 
performance variables do not contribute sufficiently toward the total allowance. 
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Box 2: Improving the formula of the teacher performance allowance: What should it look like? 


The team managed to obtain anonymized population data of teachers receiving the TKD allowance between March 
and December 2017. Using this dataset, we tried to measure the extent of the causal impact of each component 
on the allowance amount received by program recipients. Below is a summary of the statistics of the components 
factoring in the TKD of teachers in November 2017. 


Table A. Summary statistics of TKD components for Teachers, November 2017 


Mean Std. Dev. 
Attendance 98.80 4.18 
Teacher Competency Test (UKG) 10.54 8.70 
Teacher Assessment (PKG) 20.99 6.09 
National Exam 5.11 3.89 
National Exam — Increment 3.65 3.75 
Non-academic Achievement 6.21 4.85 
Student behavior 9.49 2.19 


Data from 23,495 teachers in DKI show that they would receive an average of IDR 8,768,129 as their nominal 
allowance baseline, i.e., this is the maximum amount they would receive if they were to get full marks on both the 
attendance and performance components. Using the above information, a simple simulation was conducted to 
see the variation in allowances received by three hypothetical teachers: Teacher A with an average score for all 
components as described in Table A, Teacher B with a similar attendance level, but performing 10 percent less 
than Teacher A, and Teacher C who has 10 percent lower attendance compared with both teachers, but performing 
similarly to Teacher A. The allowance outcomes are shown in Table B. 


Table B. Simulation of TKD allowance in DKI Jakarta 


Teacher A 


Teacher B 


Teacher C 


Attendance 


98.80 


98.80 


88.92 


. Teacher Competency Test (UKG) 


10.54 


9.49 


10.54 


. Teacher Assessment (PKG) 


20.99 


18.89 


20.99 


. National Exam 


5.11 


4.60 


5.11 


3.65 


3.29 


3.65 


Non-academic Achievement 


6.21 


5.59 


6.21 


Bullying, student brawling, etc. 


9.49 


8.54 


9.49 


a. 
b 
c 
d 
e. National Exam — Increment 
f. 
g. 
h 


. Share of Attendance (70% x a) 


69.16 


69.16 


62.24 


Allowance portion of attendance 


6,063,971 


6,063,971 


5,457,573 


i. Share of Performance (30% x (b +c+d+e+f+g) 


16.80 


15.12 


16.80 


Allowance portion of performance 1,473,195.69 1,325,876.12 1,473,195.69 


Total Allowance Received (h + i) 7,537,166 7,389,847 6,930,769 


Proportion to the current scheme 100% 98% 92% 


Based on the simulation above, we see that although Teacher A performs 10 percent better than Teacher B (based 
on the six factors of performance), the allowance received by Teacher B is only two percent smaller than the 
amount received by Teacher A. However, due to having a 10 percent lower attendance rate, Teacher C receives an 
allowance which is eight percent lower. This simulation highlights how the current formula failed to provide 
sufficient incentives for teachers to improve their performance. Since attendance matters more, teachers will 
receive a relatively full amount of their allowances as long as they have full marks for their attendance. From Table 
A we can also see that the variation in teacher attendance is relatively small, signaling low absenteeism rates of 
civil servant teachers in DKI Jakarta. That said, it is time for DKI Jakarta to think about putting greater weight on 


teacher performance, in the hope of improving student learning outcomes. 


4. Do teachers self-report improvements in performance? 


Do teachers feel that the allowance amount they receive affects their performance? 
Respondents of the study were asked to evaluate their perceptions of the program and its 
relationship to their performance improvement. The responses were recorded as a binary 
value: YES, if they thought their performance had improved since they received the TKD 
allowance, or NO, if they thought there was no performance improvement because of the 
program. 


The exercise below shows that, based on the sample data collected in the study, there is no 
link between the size of allowance and teacher performance. The only variable that shows a 
statistically significant value is the gender variable. Male teachers have a higher probability of 
reporting performance improvement than their female colleagues. Other factors, such as a 
teacher’s educational background or their level as a civil servant, as well as the size of schools, 
proxied using the number of teachers, showed insignificant values. Note that teacher 
performance here is the perception of the teacher himself/herself of their performance. 


Table 9. Variables influence on teacher performance 


Variables Coef. 
Allowance amount 0.009 
Number of teachers in schools -0.002 
Gender (1=male, 0=female) 0.449*** 
Education background -0.091 
Age 0.178 
Age (square) -0.002 
Teaching experience -0.019 
Civil servant level 0.094 


Y=teacher performance assessment: 1= improve, O = not improve. 


***Sig. at 0.001 
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Annex 1: Teacher’s Questionnaires 


PART A: IDENTITY OF SCHOOL /INSTITUTION 


INTERVIEW BEGINS AT: ws (WIB/WITA/WIT) * 
A.1 NPSN (National School Principal 
Number) 
A.2 Name of School 
A.3 School Level / Educational 1. Kindergarten 2. Primary Education 
Institution Level 3. Junior High School 4. Senior High School 
5. Vocational High School — 6. School for Children with 
Disabilities 
A4 School Status/Institution 1. Public 2. Private 
A5 School Address 
A.6 Sub-District/District 
A.7 Regency/City 
A.8 Province 
A.9 Number of Students A. Kindergarten/Early Childhood Education 
(Choose the relevant school level) 1. Ages 3-4 years old Number of Class Parallel 
2. Ages 4-5 years old___ Number of Class Parallel 
3. Ages 5-6 years old Number of Class Parallel 
B. Primary Education School 
1. Gradel: ___— | Number of Class Parallel 
2. Grade2: Number of Class Parallel 
3. Grade3: Number of Class Parallel 
4. Grade 4: Number of Class Parallel 
5. Grade5: Number of Class Parallel 
6. Grade6: Number of Class Parallel ___ 
C. Junior Secondary School 
7. Grade7: ____ Number of Class Parallel 
8. Grade8: ____ Number of Class Parallel 
9. Grade9: Number of Class Parallel 
D. Senior High School/Vocational High School 
10. Grade 10: ~~ ~—~Numberof Class Parallel 
11. Grade 11: ~~ Numberof Class Parallel 
12. Grade 12: ~~ ~—s Number of Class Parallel 
E. School Children with Disability 
1. Primary School Level ___Number of Class Parallel __ 
2. Junior Secondary School Level ___ Number of Class Parallel 
3. Senior High School Level ___ Number of Class Parallel 
A.10_ | Number of Teachers ee 
A.11 | Number of Extracurricular activities | 
A.12 Number of School Award 1. District Level 
a. Field year 
b. Field year 
c. Field year 
2. Provincial Level 
a. Field year 
b. Field year 
c. Field year 


26 


3. National Level 
a. Field year 
b. Field year 
c. Field year 
4. International Level 
a. Field year 
b. Field year 
c. Field year 


RESPONDENT IDENTITY 


B.1 Name 
B.2 Sex 1. Male 
2. Female 
B.3 Education History A. S1, Course: Year of grad. 
B. $2, Course: Year of grad. 
C. $3, Course: Year of grad. 
B.4 Age ____ years 
B.5 Marital Status 2. Single 2. Married 3. Widowed/er or divorced 
B.6 NoTel./MobilePhone | 
B.7 Level of employing school 1. PAUD/TK/SLB 2. SD 
3. SMP 4. SMA 5. SMK 
B.8 Name of School 
B.9 Employment status 1. CPNS/Civil Servant Candidate 
2. PNS/Civil Servant 
B.10 First year as a Civil Servant 
B.11 Category/level 1. Il/a -Il/d 
2. IN/a-Ill/b 3. II/c —IlI/d 
4. IV/a-IV/c 5. IV/d-IV/e 
B.12 Length of service as a _____ year(s) —_—s month 
teacher 
B.13 Current position 
B.14 Length of service in current |_ __ year(s) __ _— month 
position 


PART C: KNOWLEDGE OF SUB NATIONAL PERFORMANCE ALLOWANCE (TKD) 
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Question 


Respondent’s Answer 


Enumerator Remarks 


Are you aware of the 
Governor's regulation 
regarding Regional 
Performance Allowances for 
Principals, Deputy Principals 
of Teachers, School 
Supervisors, and pamong 
belajar (nonformal education 
teachers) ? 


1. Yes 
2. No 


When were you first aware 
of the Regulation of Jakarta 
Governor on Sub National 
Performance Allowance for 
School Principals, Deputy 
Principals, Teachers, 
Supervisors, Overseers and 
Pamong Belajar? 


2017 

2018 

Just recently 
Don’t know 


an a eae 


How did you know about the 
Jakarta Governor 


A. Dinas Pendidikan/Education Agency 
B. Other government agencies; 


Regulation? SPOCIEY sas edi fesvoccestsdsaaietcedesteinssseznecoussescetaaseaecs 
C. Peers, 
SPOCIEY sodas src ataasecGties sas tesen canton cond. deytonenetias 
D. Media, 
SPOCILY As sss8s A cizserceshessgsssheataastascarceseeeareninsen 
E. Website/Internet 
F. Others, 
SPOCIfYscisccisharezcseniss casundis caceheieebdaes aesaenaestaes 
Do you have copies of 1. Yes 
regulatory documents 2. No 


related to regional 
performance benefits (TKD)? 


. What regulations or 
document(s) do you have 
copies of, related to the 
Performance Allowance of DKI 
Jakarta? 


How would you assess your 
understanding of these 
regulations/ documents? 
(1=don’t understand at all, 
2=don’t really understand, 
3=understand, 4=fully 
understand) 


Regulations on TKD Understanding 
A. Pergub DKI No. 409 of 2016 12 3 4 
B. Pergub DKI No. 149 of 2017 12 3 4 
C. Pergub DKI No. 22 of 2017 12 3 4 
D. Ingub DKI No. 129 of 2016 12 3 4 
E. Technical guide of TKD 12 3 4 
calculation 
F. Others, specify 12 3 4 
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6. How did the government 
provide information for you? 


How many times was 
information provided 
(frequency of information 
dissemination)? 


7. What applications do you 


use related to allowance 
(TKD) for Teacher and 
Education Staff? 


8. How difficult is it for 
you to use the app? 


Give an explanation regarding 
your answer. 


9. What are the attendance 
components and indicators 
in TKD for Teacher 
Assessment? 


Types of dissemination of information Frequency 
A. TKD-specific dissemination of 
information on with other schools 
B. Dissemination of information on this 
policy and other policies 
C. Explanation from Education Agency 
Team (with head of department, 
section, supervisors, etc.) 
Information through website 
E. Others, specify 
Application Function 
A. e-Absensi 
B. e-Kinerja 
C. e-KP 
D. eTkdbkd.jakarta.go.id 
E. Other,..........00. 
Level of Difficulties Explanation 
1. Not Difficult 
2. Quite difficult 
3. Difficult 
4. Very Difficult 
Indicator of presence (for the Yes No 


calculation of latest TKD received) 


Absence without permission 


Absence with permission 


Sick 


Leave 


Sabbatical leave 


Leave for important matters 


Sick leave 


Maternity leave 


Hours late (hour) 


Hours of early return (hour) 


Al-|-|zr]a|=|m|o]o]@]> 


Others: 
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10. What are the components Work performance indicator (for the | Yes No 


and indicators of work calculation of latest received TKD) 
performance of TKD for the A. UKG 
Teacher's assessment? B. Assessment of Teacher 
Performance 
C. School’s Academic 
Performance 


- Calculation of National 
Exam Absolute Final Score 
- — Improvement of National 
Exam Score 
D. School’s Non-Academic 
Performance 

- Performance of OSN, O2SN, 
FLS2N, LKS, etc. 

- | Number of Brawls, Narcotics 
Abuse, Bullying, financial 
collection levied on the 
student by school (Per 
Month) 

E. Others: 


11. Other issues related to 
knowledge/socialization of 
TKD Teacher and Education 
Staff 


PART D: CALCULATION AND INPUT OF TKD 


Question Respondent’s Answer Enumerator Remarks 
1. Do you know how to 1. Yes 
calculate TKD for 2. No 
teachers? 


How do you know? 
If you don’t know, who 
assisted you in TKD 


calculation? 
2. In 2018, when was the Month Amount of TKD/ month | Frequency 
last time you receive 1. August 
TKD? 2. September 
3. October 
4. November 
For how many months did 5. Other 


you regularly receive TKD? 
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3. What are the Component Percentage 
components and A. Presence 
percentages considered B. Work Performance 
for your TKD C. Others, specify 
calculation?“ = 8  —|l||_ *! _ 4a gaielaveedteshiemevorrneeahionletiuineianeaas 
4. For presence (absence) Indicator of presence (for the calculation of | Number of 
component, please latest TKD received) days/hour 
complete the indicators L. Absence without permission 
used to calculate the M. Absence with permission 
presence component of N. Sick 
your TKD per latest TKD O. Leave 
in 2018 P. Sabbatical leave 
Q. Leave for important matters 
R. Sick leave 
Ss. Maternity leave 
T. Hours late (hour) 
U. Hours of early return (hour) 
WV, OCH EMS 23s vcs deteatais saci gts cic tapnceseaseacedtieecanee 
5. For work performance, Work performance indicator (for the % Values 
please complete the calculation of latest received TKD) 
indicator values that F. UKG 
were used to calculate G. Assessment of Teacher 
the work performance Performance 
component of your TKD H. School’s Academic Performance 
per latest TKD in 2018 - Calculation of National Exam 
Absolute Final Score 
- Improvement of National Exam 
Score 
Il. School’s Non-Academic 
Performance 
- Performance of OSN, O2SN, 
FLS2N, LKS, etc. 
- | Number of Brawls, Narcotics 
Abuse, Bullying, financial 
collection levied on the student 
by school (Per Month) 
J. Others: 
6. Did you experience Level of Difficulty Explanation 
simieuine> 1. Not Difficult 
calculating the 
attendance aspect of 
TKD? If there are 2. Quite difficult 
please explain what 
difficulties are faced — 
3. Difficult 
4. Very difficult 
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7. Did you experience Level of Difficulty Explanation 
difficulties in 1. Not Difficult 
calculating aspects of 


work performance in 2. Quite difficult 

TKD? If there is, 

please explain what 3. Difficult 

difficulties are faced 

4. Very difficult 
8. Whois involved in Parties Involved Function 

assessing or A. School Supervisor 
calculating aspect of | B. B. Pusdatikomdik (Center of 
work performance in Data and Education 
TKD, before Communication 
inputting? Information Technology) 


C. Suku Dinas Pendidikan (Sub 
Educational Office in the 
City) 


D. P2KPTKK (Center for the 
Development of 
Competency of Teachers, 
Educational Personnel and 
Vocational Program) 


E. Personnel of School data 
operation 


F. Others.......... 


9. What are the steps Describe the TKD Input Scheme 
and process to input 
data on the TKD 
system? 


Give details of the 
process 


Provide separate paper 
if needed 


10. What is the task of 
school operator, 
relative to the TKD 
GTK System? 


Assist in inputting data 
Assist in calculating achievement (data) for each variable 
Estimate/predict result of TKD one would achieve 


IN P> 
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Question 


PARTE: 


Respondent’s Answer 


UALITY OF TKD DATA 


Enumerator Remarks 


How sufficient are the 1. Insufficient 
components and 2. Sufficient 
indicators used to 3. Numerous 
calculate TKD GTK in 4. Too Numerous 
assessing your 
performance? 
Please explain your 
answer! 
How complicated is it 1. Easy 
to calculate TKD values | 2. Quite complicated 
in assessing your 3. Complicated 
performance? 4. Highly complicated 
Please explain your 
answer! 
Do you think the TKD 1. Yes 
formulation is 2. No 


(meaning, all have 
equal opportunity to 
achieve the highest 
value) 


Please explain your 
answer! 


3. Don’t know 


Do you know the 1. Yes 
status of the 2. No 
assessment of your 
performance 
variables? 
Please explain your 
answer! (how, when) 
How do you get A. Education Office/Dinas Pendidikan 
information on B. Website (online channel).........cccccccseeeseceteeesees 
allowance resulting C. Other governmental agencies occ eeeeeeeeeeeeeee 
from your Di, QMO nS sicsrehiscszs cnccdiectedss deskeasess ta sibediaigg cevessencessacteasseadenaesscens 
performance 
assessment? 
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How did you get this 
information? 


Is there any difference 
between your 
inputted indicator and 
the SKD status you 
receive from the 
application? 


If so, 

a. What indicators 
generally differ? 
What contributes 
to the difference? 


b. Can this be 
revised? How? 


Dag 


Yes 
No 
Don’t know 


Is there any 
verification/validation 
of your inputted data, 
prior to the 
determination of TKD 
amount you would 
receive? 


If so, who undertakes 
that process? 


What is the process 
like? 


ae 


Yes 
No 
Don’t know 


Do you know the 
amount of TKD 
received monthly 
(IDR)? 


How do you know? 


y 


Yes 
No 
Don’t know 


Do you think the 
percentage of absence 
and work 
performance 
components of TKD 
need revision? 


If so, what should be 
the correct 
percentage? 

What are your reasons 
for the revision? 


Ny 


Yes 
No 
Don’t know 


10. 


For absence 
component of TKD, is 


S 


No need to change (should be maintained) 
To be omitted 
To be added 
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there any variable you 
think should change? 


If variables need to 
change, which one(s) need 
to be omitted, to be 
added or modified, and 
what are the reasons? 


4. Tobe modified 


11. For work performance 
component of TKD, is 
there any variable you 
think should change? 


If variables need to 
change, which one(s) need 
to be omitted, added or 
modified, and what are 
the reasons? 


What about the 
percentage of each 
indicator? 


No need to change (should be maintained) 
To be omitted 

To be added 

To be modified 


Pw NE 


12. Do you have other 
issues related TKD 
data quality? 


PART E: IMPACT OF TKD ON TEACHER BEHAVIOR 


Question Respondent’s Answer Enumerator Remarks 

1. Is the amount of TKD 1. Yes 

you receive sufficient? 2. No 

If otherwise, why? 

What should the 

amount be? 
2. Has the TKD you Changes Before TKD started After TKD started 

receive impacted on 1. Yes 

your performance as 

teacher? 

What changes have 2. No 

you experienced? 
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3. For 2018, what is the 
trend of the result of 
your performance 
assessment by the 
school supervisor 
within the last three 


Option Proof of Change Proof of Change 
in 2017 in 2018 
1. No 
change/constant 


2. Improving 


months? 
3. Declining 

What instrument(s) 

have been used? 
4. What attempts have A. No special attempt; the same as prior to TKD 

you made to improve B. None because | have passed UKG 

your KKG grades? C. Participated in more teacher training 

D. Got more learning materials 

Please explain what you Eos JOU GMS poles ces eects hedesedsaieccsnteroesieeesedcsntece 


have done (training 
courses attended, 
additional materials). 


5. What attempts have 
you made to improve 
your PKG grades 
(Teacher Performance 
Assessment)? 


Please explain what you 
have done (training 
courses, additional 
materials). 


Participated in more teacher training 
Active participation in KKG/MGMP 


Writing scientific article(s) for journals 


™m™909> 


OUENS istcsicevcecdecciedintteasecca cobeck Youssessathecees 


No special attempt; the same as prior TKD 


Active participation in seminars/workshops 


6. If you have ever 
attended training 
courses, who were the 
organizers? 


Please write the 
number of training 
courses (frequency) 
you attended during 
previous TKD and the 
current TKD. 


What have you done to 
attend more training 
courses? 


Training Organizers 


Freq. Freq. 
old new 
TKD TKD 


A. Training is organized by Education 
Office 


B. Training from other local 
government entities 


C. Training from non-governmental 
organizations 


D. Online training 


E. Others: 
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7. What is your time 
allocation for learning 
activities during the 
previous TKD and the 
current TKD? 


Please explain how you 
prepare for it 


Activities Old 
TKD 


New 
TKD 


Preparation for learning and 
teaching 


Preparation of learning tools 
(materials/learning media) 


Other: 


8. What attempts have A. No special attempt; the same as prior to TKD 
you made to improve B. Added hours for extracurricular activities 
school performance in C. Coaching of non-academic competence (life skills) 
non-academic areas? D. Added learning hours for subjects that are part of 
competitions 
Please explain what E. Became facilitator for events 
you have done! Be. WOEMENS sit iecccscezecscsuaes icons sats csunceutensunsoacuvcetescuesebaadevesruscnacss 
9. What attempts have A. No special attempt; the same as prior to TKD 
you made to improve B. Additional teaching hours 
student/pupil’s C. Improve teaching skills 
learning outcomes? D. Use multiple pedagogic approaches 
E. Use comprehensible learning tools 
Please explain what Fi. “QU ORS sccsticsshacisdeccczncasd sated csahcatancnsdscecsssadcane test iancatensabadoaaes 
you have done! 
10. Do you think all staff 1. Yes 
at the school have 2. No 
performed better 
since the 
implementation of 
TKD? 
Please explain your 
answer and present your 
evidence 
11. What attempts have A. No special attempt; the same as prior to TKD 
been made to B. Provide direction to students 
prevent student C. Organize more extra-curricular activities 
brawls, narcotics D. Organize regular religious activities 
abuse, bullying, and E. Severe sanctions for offenders 
financial collection F. Intensive communication with parents 
levied on the Gi, SOUMONS S aiscseseiceesieens Heh cehccoersass ses lesccesvedensasdéeatuterteesiegeoadcisaeess 


student by school 
(per month)? 


Please explain your 
answer and present your 
evidence 


Instruction: 


PART F: GENERAL RESPONSE OF TKD TEACHERS 


1. Read each of the questions carefully 


2. Choose one of five scale options based your assessment of each statement, 1 is the lowest and 5 is the highest 
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2 
[o) 


RESPONSE TO TKD PROGRAM 


SCORE 


Encourages me to work better 


Improves my income significantly 


Motivates me to work longer than before 


Increases teamwork in school 


Motivates me to improve my competency 


Develops competitive spirit among teachers 


Improves teacher discipline in their work 


Improves teacher productivity 


WlCOIN DI) MBI] WIN {rR 


Teachers are more focused on student learning outcomes 


10 Encourages teachers use their money to buy learning materials 


11 TKD formula is not fair 


12 The amount of TKD is too high for me 


13 The amount of TKD is not enough to improve behavior 


14 Work behavior is more or less the same compared to before TKD 


15 No significant impact on school performance 


16 Initiates unhealthy competition among teachers 


17 The difference in allowance received among school staff is high 


18 It is unfair as young teachers can receive more than older teachers 


19 No relation between performance and allowance 


20 Do not agree with score used in the formula 


THE INTERVIEW ENDSAT: ss ——S——_—s(WIB/WITA/WIT)* 


DURATION OF INTERVIEW: (HOUR) (MINUTES) 


REMARKS: 


Thank you for your participation. 


38 


Annex 2: Principal’s Questionnaires 


PART A: IDENTITY OF SCHOOL /INSTITUTION 


INTERVIEW BEGINS AT: =. Ss (WIB/WITA/WIT) * 


A.1 NPSN (National School Principal 


Number) 
A.2 Name of School 
A.3 School Level / Educational 1. Kindergarten 2. Primary Education 
Institution Level 3. Junior High School 4. Senior High School 
5. Vocational High School — 6. School for Children with 
Disabilities 
A.4 School Status/Institution 3. Public 2. Private 


A5 School Address 

A.6 Sub District/District 
A.7 Regency/City 

A.8 Province 


A.9 Number of Students 
(Choose the relevant school level) 


F. Kindergarten/Early Childhood Education 

4. Ages 3-4years old___ Number of Class Parallel 
5. Ages 4-5 years old Number of Class Parallel 
6. Ages 5-6 years old Number of Class Parallel 
G. Primary Education School 

13. Gradel: ___— | Number of Class Parallel 


14. Grade 2: — ~— ~——sNumberof Class Parallel 
15. Grade 3: | ~~ ~——~Numberof Class Parallel 
16. Grade 4: _— — ~——sNumberof Class Parallel 
17. Grade 5: ___——~———s Number of Class Parallel 
18. Grade 6: ——~———s Numberof Class Parallel 


H. Junior Secondary School 


19. Grade 7: ___—~—~—sNumberof Class Parallel 
20. Grade 8: ____ ~—~Numberof Class Parallel 
21. Grade 9: ___ ~——s Number of Class Parallel 
I. Senior High School/Vocational High School 
22. Grade 10: _— ~——~—— Number of Class Parallel 
23. Grade 11: ~~ ~~ Number of Class Parallel 
24. Grade 12: —s Number of Class Parallel 
J. School Children with Disability 
4. Primary School Level Number of Class Parallel 
5. Junior Secondary School Level ___ Number of Class Parallel 
6. Senior High School Level ___ Number of Class Parallel 
A.10 | Number of Teachers eee 
A.11 | Number of Extracurricular activities | 
A.12 | Number of School Award 5. District Level 
d. Sector year 
e. Sector year 
f. Sector year 
6. Provincial Level 
d. Sector year 
e. Sector year 
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f. Sector. year. 
7. National Level 
d. Sector year 
e. Sector year. 
f. Sector. year. 
8. International Level 
d. Sector _year____ 
e. Sector _year____ 
f. Sector. _year_____ 


PART B: RESPONDENT IDENTITY 


B.1 Name 
B.2 Sex 3. Male 
4. Female 
B.3 Education History D. S1, Department: Year of grad. 
E. $2, Department: Year of grad. 
F. S3, Department: Year of grad. 
B.4 Age _____ years 
B.5 Marital Status 4. Single 2. Married 3. Widowed/er/ divorced 
B.6 NoTel./MobilePhone | — see 
B.7 Level of employing school 2. PAUD/TK/SLB 2. SD 
3. SMP 4. SMA 5. SMK 


B.8 Name of School 
B.9 Employment status 3. CPNS/Civil Servant Candidate 
4. PNS/Civil Servant 


B.10 Date of first time as a Civil 
Servant (DD/MM/YY) 


B.11 | Category 3. IIa -II/d 

4. I/a-Ill/b 3. III/c—III/d 

4. |IV/a-IV/c 5. IV/d-IV/e 
B.12 | Length of Service as a _____year(s)__ —_—s month 

teacher 
B.13 Current position 1. Principal 
2. Deputy Principal 
for 

B.14 | Length of service in _____ year(s) __ __ month(s) 


current position 
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PART C: KNOWLEDGE OF SUB NATIONAL PERFORMANCE ALLOWANCE (TKD) 


Question 


Respondent’s Answer 


Enumerator Remarks 


Are you aware of the 
Governor's regulation 
regarding Regional 
Performance 
Allowances for 
Principals, Deputy 
Principals of Teachers, 
School Supervisors, 
and pamong belajar 
(nonformal education 
teacher)? 


When were you first 
aware of the 
Regulation of Jakarta 
Governor on Sub 
National Performance 
Allowance for School 
Principals, Deputy 
Principals, Teachers, 
Supervisors, Overseers 
and Pamong Belajar? 


How did you know 
about the Jakarta 


1. Yes 

2. No 

5. 2017 

6. 2018 

7. Just recently 

8. Don’t know 

G. Dinas Pendidikan/Education Office 


H. Other government agencies; 


Governor Regulation? SPOCIEY: scctses cence sncscacsvactssunascasststtccdencesneotcosesins 
I. Peers, 
SDOGIIY: sacescivsecscet asuasedevscisnscesvanteesivnlvandapeverte 
J. Media, 
SDSCILY. deusnvcasuescces dures steesvcdedenteushes cordieadcerete 
. Website/Internet 
L. Others, 
SPOCIEY 5s scicwsi ses bencssstachicvesscnvedsseteasvesspeachevnrs 
4.Do you have copies | 3. Yes 
of regulatory 4. No 
documents related to 
regional performance 
benefits (TKD)? 
Question Respondent’s Answer Enumerator Remarks 
. What regulation or Regulations on TKD Understanding 
document(s) do you G. Pergub DKI No. 409 of 2016 12 3 4 
have copies of, related H. Pergub DKI No. 149 of 2017 12 3 4 
to Performance |. | Pergub DKI No. 22 of 2017 1 2 3 4 
Allowance of DK! J. Ingub DKI No. 129 of 2016 a 
Jakarta? K. Technical guide of TKD calculation |1 2 3 4 
L. Others, specify 12 3 4 


How would you assess 
your understanding of 
these regulations/ 
documents? (1=don’t 
understand at all, 
2=don’t really 


attendance 
components and 
indicators in TKD for 
Teacher Assessment? 


calculation of latest TKD received) 


understand, 
3=understand, 4=fully 
understand) 

6. How did the Types of dissemination of information Frequency 
government provide F. TKD-specific dissemination of 
information for you? information on with other schools 

G. Dissemination of information on this 
policy and other policies 
H. Explanation from Education Agency 
Team (with head of department, 
section, supervisors, etc.) 
How many times was |. Information through website 
information provided J. Others, specify 
MHREQUEMOYOR Ill = is abla acne ciletvena atid sReeeaioine vides 
information 
dissemination)? 
7. What applications do Application Function 
you use related to 
GTK TKD? F. e-Absensi 
G. e-Kinerja 
H. e-KP 
|. eTkdbkd.jakarta.go.id 
J. OTNEL cctstecsvends 
8. What is the level of Level of Difficulty Explanation 
difficulty in using the 5. Not Difficult 
application? 
6. Quite difficult 
Give an explanation 7. Difficult 
regarding your answer? 
8. Very Difficult 
9. What are the Indicator of presence (for the Yes No 


W. Absence without permission 
X. Absence with permission 

Y. Sick 

Z. Leave 


AA. Sabbatical leave 
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BB. 


Leave for important matters 


CC. 


Sick leave 


DD. 


Maternity leave 


EE. 


Hours late (hour) 


FF. 


Hours of early return (hour) 


GG. 


Others: 


10. What are the 
components and 
indicators of work 
performance of TKD 
for Principal 
assessment 


Work performance indicator (for the 
calculation of latest received TKD) 


Yes 


No 


K. 


Accuracy of KJP Distribution 


L. 


Assessment of Principal 
Performance 


Teacher Competency Test 


M. 
N 


School’s Academic 
Performance 


- Calculation of National 
Exam Absolute Final Score 


- Improvement of National 
Exam Score 


School’s Non-Academic 
Performance 


Performance of OSN, O2SN, 
FLS2N, LKS, etc. 


Number of Brawls, Narcotics 
Abuse, Bullying, financial 
collection levied on the 
student by school (Per 
Month) 


P. 


Others: 


11. Other issues related 
to knowledge / 
dissemination of TKD 
GTK 
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PART D: CALCULATION AND INPUT OF TKD 


Question Respondent’s Answer Enumerator Remarks 
1. Do you know how to 3. Yes 
calculate TKD for 4. No 
teachers? 
How do you know? 
If you don’t know, who 
assists you in TKD 
calculation? 
2. In 2018, when was the Month Amount of TKD/ month | Frecuency 
last time you receive 6. Agustus 
TKD? 7. September 
8. Oktober 
9. November 
Per how many months do 10. Lainya... 
you regularly receive TKD? 
3. What are the Component Percentage 
components and D. Presence 
percentages considered E. Work Performance 
for your TKD F. Others, specify 
CalCulatIGWT’ = =§«-—« || _—_—_* seghinvpdesedeasdesistsiiedeniansnibinsniabuassarsdtin dius 
4. For presence (absence) Indicator of presence (for the calculation of | Number of 
component, please latest TKD received) days/hour 
complete the indicators HH. Absence without permission 
used to calculate the ll. Absence with permission 
presence component of JJ. Sick 
your TKD per latest TKD KK. Leave 
in 2018 LL. Sabbatical leave 
MM. Leave for important matters 
NN. Sick leave 
OO. Maternity leave 
PP. Hours late (hour) 
QQ. Hours of early return (hour) 
RR ORR CNS? a cavsiesscsccsescandesdductusastedaadectesnsnwastiansa 
5. For work performance, Work performance indicator (for the % | Values 


please complete the 
indicator values that 
were used to calculate 
the work performance 
component of your TKD 
per latest TKD in 2018 


calculation of latest received TKD) 


A. Accuracy of KJP Distribution 


B. Assessment of Principal Performance 


C. Teacher Competency Test 


-  School’s Academic 
Performance 


- Calculation of National Exam 
Absolute Final Score 


D. Improvement of National Exam Score 
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-  School’s Non-Academic 
Performance 


- Performance of OSN, O2SN, 
FLS2N, LKS, etc. 


E. Number of instances of Brawls, 
Narcotics Abuse, Bullying, financial 
collection levied on the student by 
school (Per Month) 


Did you experience 
difficulties in 
calculating the 
attendance aspect of 
TKD ? If yes please 
explain what 
difficulties you faced 


F. Others: 


Level of Difficulty Explanation 


Not Difficult 


. Quite difficult 


Difficult 


. Very difficult 


Did you experience 
difficulties in 
calculating work 
performance in TKD? 
If yes, please explain 
what difficulties you 
faced 


Level of Difficulty Explanation 


8. Not Difficult 


9. Quite difficult 


10. Difficult 


11. Very difficult 


8.Who is involved in 
assessing or calculating 
aspect of work 
performance in TKD, 
before inputting? 


Parties Involved 


Function 


G. School Supervisor 


H. B. Pusdatikomdik (Center of 


Data and Education 
Communication 
Information Technology) 


Suku Dinas Pendidikan (Sub 
Educational Office in the 
City) 


P2KPTKK (Center for the 
Development of 
Competency of Teachers, 
Educational Personnel and 
Vocational Program) 
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K. Personnel of School data 
operation 
L. Others.......... 


9. What are the steps Describe the TKD Input Scheme 
and process to input 
data on the TKD 
system? 


Give details of the 
process 


Provide separate paper 
if needed 


10. What is the task of 
school operator, 
relative to the TKD 
GTK System? 


Assist in inputting data 

Assist in calculating achievement (data) for each variable 
Estimate/predict result of TKD one would achieve 

OEM OLS sseseecch Ma csdeueste astsaccassshactdeattcarctavesusins crevevecacantes 


iG: 7m 


PART E: QUALITY OF TKD DATA 


Question Respondent’s Answer Enumerator Remarks 
1. How sufficient are 5. Insufficient 
the components and 6. Sufficient 
indicators used to 7. Numerous 
calculate TKD GTK in 8. Too Numerous 
assessing your 
performance? 
Please explain your 
answer! 
2. How complicated is 5. Easy 
it to calculate TKD 6. Quite complicated 
values in assessing 7. Complicated 
your performance? 8. Highly complicated 


Please explain your 
answer! 
3. Do you think the TKD 4. Yes 

formulation is fair for No 
all? (meaning, all have 6. Don’t know 
equal opportunity to 
achieve the highest 
value) 


uy} 


Please explain your 
answer! 
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Do you know the 
status of the 
assessment of your 
performance 
variables? 


Please explain your 
answer! (how, when) 


Yes 


How do you get 
information on 
allowance resulted 
from your 
performance 
assessment? 


How is information 
acquired? 


mgm im 


Agency of Education/Dinas Pendidikan 


Website (online channel) 


Other governmental Agencies .........cccccccessesssssseeeseesesseaeees 


Othe rSiscsrstncsceinscleiex: 


Is there any difference 
between your 
inputted indicator and 
the SKD status you 
receive from the 
application? 


If so, 

a. What indicators 
generally differ? 
What contributes 
to the difference? 


b. Can this be 
revised? How? 


eA 


Yes 
No 
Don’t know 


Is there any 
verification/validation 
of your inputted data, 
prior to the 
determination of TKD 
amount you would 
receive? 


If so, who undertake 
that process? 


What is the process 
like? 


A 


Yes 
No 
Don’t know 


Do you know the 
amount of TKD 
received monthly 
(IDR)? 


How do you know? 


wi 


Yes 
No 
Don’t know 
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If variables need to 
change, which one(s) need 
to be omitted, added or 
modified, and what are 
the reasons? 


What about the 
percentage allocated to 
each indicator? 


9. Doyou think the 4. Yes 
percentage of absence 5. No 
and work 6. Don’t know 
performance 
components of TKD 
need revision? 

If so, what should the 
correct percentage 
be? 

What are your reasons 
for the revision? 

10. For absence 5. Noneed to change (should be maintained) 
component of TKD, is 6. Tobe omitted 
there any variable you 7. Tobe added 
think should change? 8. Tobe modified 

If variables need to 

change, which one(s) need 

to be omitted, to be 

added or modified, and 

what are the reasons? 

11. For work performance 5. Noneed to change (should be maintained) 
component of TKD, is 6. Tobe omitted 
there any variable you 7. Tobe added 
think should change? 8. Tobe modified 


12. Other issues related 
TKD data quality? 
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PART E: IMPACT OF TKD TO PRINCIPALS’ BEHAVIOR CHANGE 


present the evidence for 
what you have done! 


Question Respondent’s Answer Enumerator Remarks 
1.ls the amount of TKD 1. Yes 
you receive sufficient? 2. No 
If otherwise, why? What 
should the amount be? 
2. Has receiving the TKD 1. Yes 
impacted your 2. No 
performance as 
principal/deputy 
principal? 
What changes do you 
experience? 
3. What have you done to i. No special attempt, the same as prior to TKD 
ensure that KJP is well ii. More intensive household survey to candidate 
targeted? recipients 
iii. Verification of candidate recipient data 
iv. Impose sanctions on students who falsify data 
v. Grievance mechanism for community related to 
candidate recipients 
vi. Dissemination of information to candidate recipients 
Please explain and Vib “OUMORS sedcseeccateidechvscwcks dace Satesscuneaas cacencaneedeeteenteseiuceranéatens 


4. How many students are 
recipients of KJP/KJP 
Plus? 

How many are 
mistargeted? 


If there are cases of 
mistargeting, how did 
they manage to be 
recipients of KJP? 


KJP recipient: 


__ students 


Mistargeted: _ students 


5. What attempts have you A. No special attempt; the same as prior to TKD 

made to improve school B. Better/improved school planning 

management? C. Better school finance management 

Dg. “OUNGIS i arissescesvcccucsalebedeskecdilchdsadecaaiclaverasaseatiicdieasantslidedsts 

Please explain what you 
have attempted to do! 
6. For 2018, what is the 1. No change/constant 

trend of the result of 2. Increasing 

your performance 3. Declining 


assessment by the 
school supervisor within 
the last three months? 


What instrument(s) have 
been used? 
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Question 


Respondent’s Answer 


Enumerator Remarks 


7. What attempts have you A. No special attempt; the same as prior to TKD 
made to improve the B. Increase student learning motivation 
school’s academic C. Mastery of teaching material and improvement in 
performance (student quality of learning 
learning outcomes)? D. Ensure textbook availability and enrichment 
E. Tutoring program 
F. Cooperation with parents 
Gee QRRENS Sieve ses sidectheeeds dented guessed vole dieten te aesaveotee tees 
Please explain what you 
have done! 
8. What attempts have you G. No special attempt; the same as prior to TKD 
made to improve the H. Adding hours for extracurricular activities 
school’s non-academic |. Coaching of non-academic competence (life skills) 
performance? J. Providing rewards for high achieving students 
K. Providing rewards for high performing teachers 
Lz - “Others ence ewan eins atta echt ats 
Please explain what you M. 
have done! 
9. What attempts have you G. No special attempt; the same as prior to TKD 
made to improve H. Organize more training courses 
teacher quality? |. Motivate teachers 
J. Facilitate KKG/MGMP events for teachers 
Please explain what you Ke (ORM SNS se cen ccvevciccocaseceskesviestsvsswetevedcreintavebeviecdschesreesresSisetesn'e 
have done! 
10. Do you think all staff 3. Yes 
at the school have 4. No 
performed better 
following the 
implementation of 
TKD? 
Please explain your 
answer and present your 
evidence 
11. What attempts have H. No special attempt; the same as prior to TKD 
you made to prevent |. Send students on exchange programs 
student brawls, J. Organize more extra-curricular activities 
narcotics abuse, K. Organize regular religious activities 
bullying, and financial L. Severe sanctions for offenders 
collection levied on M. Cooperation with parents 
the student by school Ni, ORNGMS § cscsessedesnccns cacescedtessesstestatscceancdveudtunsectbcestinceciensteeseest 
(per month)? 
Please explain your 
answer and present your 
evidence 
12. What attempts have A. No special attempt; the same as prior to TKD 
you made to improve B. None because all teachers have passed UKG 
the results of teachers’ C. Training/Diklat for teachers whose UKG scores are low 
UKG at this school? D. Encourage teachers to continue their studies 
Ber -OUNGIS Hse Aste cende cok cats cde loadedeiev asad daccesdarcstsbsotarteacibassisseth acess 
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Please explain your 
answer and present 
your evidence 


THEINTERVIEWENDSAT: ss —S——_—s(WIB/WITA/WIT)* 


DURATION OF INTERVIEW: (HOUR) (MINUTES) 


REMARKS: 


Thank you for your participation. 
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